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Description 

Held of the Invention 

[0001J The present invention relates to methods 
and apparatus for logging user activity on a computer- 
based information network and. more particularly, to 
unified logging of web user activity using client-side 
support 

Bacteround of the immtfan 



Summary of the InvenHnn 
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[00021 A browser is a software program run on a 
computer that allows a computer user to request, view 
manipulate and/or send information across a computer is 
network. For example, a web-based browser serves as 
a user's front-end interface to the World Wide Web 
(WWW) on the Internet As is known, using a web- 
t^,^^' a ^ t ^ lnwse ^^ ad *essor 

(Inform Resource Locator) of a website to 20 
requesta webpage (ag.. homepage) associated with 
the website that he wishes to visit The browser trans- 
mits the request over the Internet to the web server with 
which the website is associated and the server down- 
loads Jhe homepage to the browser for viewing by the 25 
user. The homepage is typically an index to other pages 
on that website that can be accessed by cficking on 
jconswhichrepresemth^ 

[00031 Typical* at the web server, the incoming 
^ J^f* fr™ *e web browser is logged (Le.. 30 
storecf). The web server then performs computations 
appropriate to fueling the request, generates a 
response, and transmits or downloads this information 
to the web browser. A log entry is generated when the 
request is received and typically contans a record of as 
attributes associated with the request such as. for 
exajnpte. when the request was received, who initiated 
the request the name of the requested object, etc 
[0004] However, such a conventional web server 
logging technique has many shortcomfogs. For exam- 4o 
P«e. information captured by a web server log is orty 
generic web server information, that is> the \vho, what 
and when- associated with the request Thus, every 
common Qato interface (CGI) program running on the 
web serveror. for that matter, arry execirtable entity that 4s 
dynarr»cally generates content has to do its own log- 
ging. Further, the manner in which the program or other 
executable entity accomplishes the logging is depend- 
ent on the web server. Aiso. web server togs only ca*> 
tureinforrnatfonattteti ^ 
server. Therefore, existing web server logs do not cap- 
ture cfient-side (i.e.. end user) activity. As a result of 
such srxxtcornings, web server logging is cisjointed in 
mat separate logs are created for various programs. 
Furthermore, the web server and, more particularly the ss 
party operating the web server, does not receive any 
information regarding how end users interact with the 
information the web server provides. 



P005] The present invention provides methods and 
apparatus for permitting unified logging and cfient-side 
activity logging. As will be evident such logging is uni- 
fied in that the techniques of the invention are not 
dependent on the server. CGI programs, or other exe- 
cutable content associated with the server. Also, infor- 
mation relating to client-side activity is advantageously 
togged at the server throughout a user's interaction with 
a downloaded document in addition to any generic web 
server information fogged at the time of a document 
request 

IP006J In an illustrative embodiment the invention 
accomplishes these and other objects and advantages 
by employing cfient-side executable content that is 
crynarnically downloaded into the browser, such as an 
applet. As is known, an applet is a fimrted-function. uH- 
fty program The cfient-side executable content or 
applet is referred to as an "agent'' The agent is prefera- 
bly downloaded into a browser running on the client 
device along with a document requested by the client 
and returned by the server. Once established in the 
browser, the agent keeps track of user interaction that 
occurs in the browser, that is. client-side interaction. 
The granularity of this tracking can be regulated, allow- 
ing the agent in the browser to collect as much inforrna- 
tfon as is available, or some subset thereof. The agent 
then periodically notifies a server-side entity referred to 
asaToggeroftrminforrT^ 

logger stores the i n fo rm ation in a log database for sub- 
sequent use. Advantageously, the present invention 
may be implemented with unmodified standard web 
browsers that support executable content 
I00O7] These and other objects, features and 
advantages of the present invention will become appar- 
ent from the following detailed description of illustrative 
emborJmerrts thereof, which is to be read in connection 
w^trwaccornpanying drawings. 

Brief Description at fne Drawings 
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FIG. 1 is a block diagram illustrating an exemplary 
embodiment of a web user activity logging arrange- 
ment according to the present invention; 

FIG. 2 is a block diagram illustrating a client-server 
system in which web user activity logging according 
to the invention may be implemented; 

FIG. 3 is a flow chart iBustrating a web user activity 
fogging method accorrjng to an exemplary embod- 
iment of the present invention; and 

FIG. 4 is a flow chart illustrating an agent data col- 
lecting method according to an exemplary embodi- 
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merit of the present invention. 



Pg&Qgd Description of Preferred Embodiments 

[000?] The invention vw'll be 5 
junction with an exemplary webbasedbrc*vserandweb 
server arrangement that is compatible with standard 
web-based browsers such as, for example, the NET- 
SCAPE browser (available from Netscape Communica- 
tions Corporation), the standard hypertext transfer 10 
protocol (HTTP), and hypertext markup language 
(HTML). Although particularly well-suited for implemen- 
tation over the Internet using Transmission Control Pro- 
tocoVhtemet Protocol (TCP/IP) connections, the 
invention is not limited to use with any particular type of is 
network or network communication protocol. The cfe- 
closed techniques are suitable for use with a wide vari- 
ety of other networks and protocols, and many different 
types of browsers installed on derrt computers. Further 
the term "processor" as used herein is intended to 20 
include any processing device, including a CPU (central 
processing unit), which may be utilized in a cfient com- 
puter, server computer, or any other computer 
employed in conjunction with the invention. Also, the 
term "memory- as used herein is intended to include zs 
memory associated with a processor or CPU. such as, 
for example, RAM, ROM. a fixed memory device (e.g., 
haid dlivB) ' J ? a removaibte memory device (ag., c5s~ 
kette). In adoption, the processing device may include 
one or more input devices, e.g., keyboard, for inputting 30 
data to the processing unit, as well as one or more out- 
put devices, e.g., CRT display and/or printer, for provW- 
ing results associated with the processing unit Further 
it is to be understood that one or more processing 
devices wrthfri the network may share associated as 
re ®°** CBS - AccorrJngry. softv^eiristnictions encode tor 
P«fomring the methodologies of the mention, 
descrtoed herein, may be stored in one or more of the 
associated memory devices (ROM, fixed or removable 
memory) and, when ready to be utilized, loaded into 40 
RAM and executed by a CPU. 

BHWQI Referring to FIG. 1, a web user activity log- 
ging system 100 according to an exemplary embodi- 
ment of the invention is shown. The system 100 
includes a browser 102 having an agent 104 associated 4s 
therewith. As previously explained, the browser 102 is a 
computer software program that runs on a computer of 
thesystemlOOaiT^^ 

information requests to various websites associated 
with network servers. The agent 104 is also a computer so 
software program that is run in conjunction with the 
browser 102 on a computer of the system 100 ajxf. as 
will be explained, provides the necessary functionality 
to permrt collection of infonTiation pertaining to web user 
actrvityaxcording to trie invents ft is to be appreciated ss 
that the agent 104 is executable content, preferably in 
the form of an applet, that is dynamically downloaded 
into a client, preferably at the time when the cfient 



receives information, e.g., HTML documents, from a 
web server in response to a URL request The applet is 
preferably mobile code downloaded by the web server 
to the client pursuant to a mobile programming lan- 
guage such as. for example, the standard JAVA lan- 
guage Thus, in this instance, the mobile code may be in 
the form of a JAVA applet. Agent 104 is realized when 
the applet starts to run within browser 1 02. 
DD011J Further, the web user activity logging system 
100 of trie invention includes a web or HTTP server 106. 
The web server is coupled tome web browser 102 via a 
corrmunication channel 10a ft is to be appreciated that 
FIG. 1 includes only one web server and one client web 
browser merely to Blustrate the concepts of the inven- 
tion, however, there may be any number of web servers 
and diem web browsers with agents operating accord- 
ing to the invention. The web server 106 also includes a 
logger 1 10 and a fog database 1 12 for storing informa- 
tion, as wifl be explained below, in accordance with the 
invention. While the logger 110 and the fog database 
112 are shown external to the webserver 106 in FIG. 1, 
it is to be appreciated that these cornponents preferably 
reside in the server 106. That is, the logger 110 is a 
computer software program that preferably runs on the 
server 1 06 and. as will be explained, provides the nec- 
essary functionality to permit web user activity logging 
at a web server in conjunction with an agent residing ri 
a client's web browser accorcfing to the invention. Also, 
the fog database 112 is preferably resident on the 
server 106 in the form of memory associated therewith. 
However, rtistobenotedthatthe logger 1 1 0 and/or tog 
database 112 may be run on one or more computers 
separate from the web server 106. In which case, the 
computer or computers on which the logger and tog 
database reside may be coupled to the web server 106 
via one or more corrmunication channels. 
10012] Advantageously, when a user makes a 
request to a web server, for example, to retrieve infor- 
mation, an agent is downloaded into the user's web 
browser in the form of executable content While the 
agent is preferably downloaded along with the docu- 
ment requested by the cfient, it is to be appreciated that 
the agent may be established in the web browser, upon 
a user's request, prior to any request for information. 
However, once in the web browser, the agent keeps 
track of. i.e.. collects and stores, all user interaction that 
occurs in the browser, that is, client-side interaction. For 
example, types of user interaction that may be tracked 
include information concerning what portion of a 
retrieved document (e.g., images, form elements, etc.) a 
user has viewed, what data has been fifled in on a form 
el emerrt. nxxfifications to that data, what sequence the 
data was filed in, etc. Also, information concerning the 
users page to page navigation through retrieved docu- 
ments, which may be stored in a browser cache, may be 
tracked and provided to the server. Of course, the above 
exanplesare merely illustrative and, as such, the type 
of user activity tracked is not limited thereto. Also, as 
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mentioned, the granularity of this tracking can be regu- 
lated with the use of information fitters associated with 
the agent, as will be explained, allowing the agent to 
collect as much information as is available, or some 
subset thereof. The agent then periodically notifies the 
server-side entity. La. the logger, of all the information 
that rt has collected. The logger processes and stores 
the information for subsequent use. 
[0013] FIG. 2 atustrates a client-server system in 
which web user activity tracking and logging accord ng 
to the invention may be rnxxemented. As shown, a client 
computer 202 and a web server 204 are coupled via a 
communication channel over the WWW network 206. 
Client 202 includes a processor 208 and associated 
memory 210 for. eg., performing the operations associ- 
ated with the browser 102 and agent 104 according to 
the invention, as described herein. On the other hand, 
the server 204 includes a processor 212 and associated 
memory 214 for. ag.. performing the operations associ- 
ated with the logger 1 10 and tog database 1 12 accord- 
ing to the invention, as described herein. The memories 
210 and 214 respectively store information associated 
with operations of the processors. Particularly, memory 
210 serves to store the information pertaining to user 
activity tracked by the agent while memory 214 serves 
to store the information logged by the logger in the form 
of the log database. Further, it is to be understood that 
the communication channel 108 of FIG. 1. may be 
implemented as a TCP/IP connection, as is known in 
the art. over the WWW 206 in FIG. 2. As mentioned, 
whie a single server computer 204 is shown in FIG. 2 
for implementing the logger and tog database, it is to be 
understood that the logger and tog database may be 
implemented on one or more separate computers. 
These computers may communicate with tie 
204 via a TCP/IP connection over the WWW 206 or over 
ctxnmunicatjon channels separate from the WWW 206. 
[00141 Referring now to FIG. 3. a ftow chart of a 
web user activity logging method 300 according to an 
exemplary embodiment of the present invention is 
shown. InrtiaHy. in step 302. a user requests a web (ag., 
HTML) document from a server (ag., 106) using a web 
browser (ag.. browser 102). The server returns the 
requested document with mobie programming lan- 
guage code representing an agent embedded therein to 
the browser, in step 304. Then, in step 306. the agent 
(ag., agent 104) begins running on the user's computer 
along with the browser and collects and stores informa- 
tfon from the browser pertaining to the user's activity, 
ag.. the user's interaction with the downloaded HTML 
document An exemplary embodiment of an agent data 
collecting method wil be explained below in the context 
of FIG. 4. Next, in step 308. the agent determines 
whether it has data for togging at the web server. This 
determination can be made based on various conoV 
tons, e.g., coi action of a certain amount of information, 
collection of a particular type of information, colectfon 
of data pertaining to any change in browser attributes, 
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etc. If there is data for logging, the agent then transmits 
some or ail of the collected information as fog informa- 
tion to the web server, in step 310. The transmission of 
the fog information from the agent to the web server 
may be periodic or based on the occurrence of some 
event If there is no data for logging, the agent merely 
continues to wait for data to be collected or probes for 
data changes, as wiO be explained. Lastly, in step 31 2 at 
the web server, the logger (ag.. logger 110) receives 
any log information transmitted by the agent and stores 
such data (ag., in the tog database 112) for future usa 
The particular format that the logger stores the data in is 
not critical. However, the data is stored in association 
with (i.a, indexed to) the particular client from which it 
was received since the web server may likely be track- 
ing and storing client information from other agents 
established in other browsers. 

[0015] Referring now to FIG. 4. a flow chart of an 
agent data coflecting method 400 according to an exem- 
plary embodiment of the present invention is shown, fn 
step 402, the agent passively waits for notification from 
the browser or downloaded cfcxxjment of a change in an 
attrfoute or attribute s associated with the browser or 
downloaded document That is, attributes (ag.. date 
fields, sequence of pages viewed, etc.) associated with 
the browser and/or downloaded document change as a 
user interacts with the browser and/or downloaded doc- 
ument However, the agent also sets a timer, in step 
404, when it first begins to wait for change notification. 
The agent monitors whether this timer has expired, in 
step 406. If ratification is received, the particular data is 
collected and stored for togging, in step 408. K the timer 
has expi red and no data is received, the agent may then 
actively probe or search the browser or downloaded 
document for changed attributes, in step 410. Also, in 
step 410, the agent may setup modified or new change 
notification criteria and may set up information selection 
titers that screen the type of attribute changes that get 
reported to the agent For example, the agent may ena- 
ble a selection titer that provides for collection of only a 
particular type of date. That is. for instance, the agent 
may only collect and store information indicat i ng which 
pages of a retrieved document the user actually viewed, 
or information tracking the sequence of page to page 
navigation performed by the user. The agent can also 
reset the timer, in step 404, so that a fixed amount of 
time is allotted for waiting for information generated by 
the new or modrfied change notficaUons and/or filter 
selections. The timer may also be reset and monitored 
for the active probing step. At the expiration of the tener, 
the agent again checks whether it has received data for 
logging (step 408). If the agent has received data, it may 
transmit the date to the logger. If not. the agent may 
repeat step 41 0 to posstory setup rnodihed or new crite- 
ria or to continue probing for changed data. Alterna- 
tively, the agent can return to the passive waiting mode 
with or without resetting the timer, rt is to be appreciated 
that the change notifications and selection filters can be 
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used to narrow the search performed by the agent in the 
probing step. 

[0016] Advantageously, the present invention sim- 
plifies the process of logging in CGI infrastructures 
since individual CGI programs do not have to generate s 
and/or maintain log information. Since the methodolo- 
gies of the invention are server and CGI-technique inde- 
pendent, the present invention provides a unified 
method for coflecting such information. It is to be appre- 
ciated that such an inventive logging facility as 10 
descrbed herein may be easily added to existing web 
servers by those of ordinary skill in the art without any 
undue experimentation. As a result of the invention, 
avaiabiSty of fogs of client-side activity and its analysis 
can lead to better understand ng of user behavior. Par- is 
ties operating web sites can use this i n form a tion to 
study how end users interact with the information they 
provide. While the invention may find application in a 
variety of computing environments, the methodologies 
are particularly useful for web-based electronic com- 20 
merce (E-commerce) as well as web-based customer 
care. 

[0017] Although illustrative embodiments of the 
present invention have been described herein with ref- 
erence to the acconpanyingdrawtngs.it is to be under- 2s 
stood that the mention is not limited to those precise 
errxxxiimerrts, and that various other changes and mod- 
ifications may be affected therein by one ski led in the 
art without departing from the scope of the invention. 

30 

Claims 

1. A method for use in a server of tracking client activ- 
ity associated with a browser running on at least 
one client device, the server and the at least onedi- ss 
ent device being in a computer network, the method 
comprising the steps of: 

transmitting executable code to the browser 
operable for collecting at least a portion of data 40 
associated with the browser-related client 
activity and for transmitting the data to the 
server; and 

logging the transmitted data associated with 45 
the browser-related client activity at the server. 

2. The method of Claim 1, wherein the executable 
code is transmitted from the server to the browser 
along with information requested by the browser. so 

3. The method of Claim 2. wherein the computer net- 
work is the internet and the requested i n formation < 
includes at least one HTML document 

56 

4. The method of Claim 2, wherein the coflected data 
is associated with browser-related client activity 
pertaining to the transmitted information. 



5. The method of Claim 1, wherein the executable 
code is in the form an applet associated with a 
mobile programming language. 

6. The method of Claim 5, wherein the mobile pro- 
gramming language is Java. 

7. A method for use in a client device of tracking dient 
activity associated with a browser running on the 
client device in conjunction with a server, the client 
device and the server being in a cornputer network, 
the method comprising the steps of: 

collecting, in accordance with executable code 
received from the server in the browser, at least 
a portion of data associated with the browser- 
related client activity; and 
transmitting, in accordance with the executable 
code, the data associated with the browser- 
related cfient activity to the server for Jogging 
therein. 

8. The method of Claim 7, wherein the executable 
code is received from the server along with informa- 
tion requested by the browser. 

9. The method of Claim 8, wherein the cornputer net- 
work is the Internet and the requested information 
includes at least one HTML document 

10. The method of Claim 8, wherein the collected data 
is associated with browser-related client activity 
pertaining to the received information. 

11. The method of Claim 7, wherein the executable 
code is in the form an applet associated with a 
mobile programming language. 

12. The method of Claim 11, wherein the mobile pro- 
gramming language is Java. 

13. The method of Claim 7, wherein the coflecting step 
further comprises the step of passively waiting for 
receipt of the data associated with the browser- 
related client activity. 

14w The method of Claim 13, wherein the collecting 
step further comprises the step of setti ng and mon- 
itoring a timer such that the step of passively wait- 
ing for the data is performed for a predetermined 
amount of time. 

15. The method of Claim 7, wherein the coflecting step 
further comprises the step of actively probing for 
data associated with the browser-related client 
activity. 

16. The method of Claim 15. wherein the collecting 
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step further comprises the step of setting and mon- 
itoring a timer such that the step of actively probing 
for the data is performed for a predetermined 
amount of time. 

5 

17. The method of Claim 7, wherein the collecting step 
further comprises the step of establishing notifica- 
tion criteria pertaining to the coflectkxi of the data 
associated with the browser-related dent activity. 

u 

18. The method of Claim 17. wherein the coflecting 
step further comprises the step of changing the 
notification criteria pertamgtothecc«ectionoftr« 
data associated with the browser-related dent 
activity. 1S 

19. The method of Claim 7, wherein the collecting step 
further comprises the step of applying selection ti- 
ters pertaining to the collection of the data associ- 
ated with the browser-related client activity. 20 

20. Apparatus for use in a server for tracking client 
activity associated with a browser running on at 
least one client device, the server and the at least 
one dient device being in a computer network, the 25 
apparatus comprising means arranged to carry out 

a method as claimed in any of claims 1 to 6. 

21. An article of manufacture for use in a server for 
tracking cfient activity associated with a browser 30 
running on at least one dent device, the server and 
the at least one client device being in a computer 
network, the article cornprising a machine readable 
medum containing one or more progra m s which 
when executed implement the steps of a method as as 
claimed in any of claims 1 to 6. 

22. Apparatus for use in a dent device for tracking di- 
ent activity associated with a browser running on 
the cfient device is conjunction with a server, the cli- 40 
ent device and the server being in a computer net- 
work, the apparatus comprising means arranged to 
carry out a method as claimed in any of claims 7 to 

19. 

45 

23. An artide of manufacture for use in a dient device 
for tracking dient activity associated with a browser 
running on the dent device in conjunction with a 
server, the dient device and the server being in a 
computer network, the article comprising a so 
machro readable medium containing one or more 
programs which when executed implement the 
steps of a method as claimed in any of daims 7 to 

19. 

55 
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